IN THE CLAIMS : 

Please amend the claims as shown below, in which deleted terms are indicated with 
strikethrough and/or double brackets, and added terms are indicated with underscoring. Please 
add new claims 13-15. The following list of claims replaces all previous versions, and listings of 
claims in the application. 

1 . (Currently amended) A method for compositing a computer-graphics image and a 
picture taken by a camera comprising: 

definin g, in accordance with conditions in which the picture is taken, a three-dimensional 
model, a viewpoint, and a plane of projection, in a space established on a compute r, the 
conditions comprising at least one of the tilt angle of the camera relative to a ground surface and 
the position of a light source relative to the camera ; 

defining lines of sight extending from the viewpoint to projection pixels on the plane of 
projection so that each of the lines of sight conforms with a ray of light incident on a pixel 
corresponding thereto of the picture taken by the camera; 

tracing the lines of sight extending from the viewpoint through the plane of projection 
and the three-dimensional model to obtain attributes of portions of the three-dimensional model 
corresponding to the projection pixels, thereby forming a two-dimensional image of the three- 
dimensional model on the plane of projection; and 

superposing the two-dimensional image on the picture to generate a composite image. 

2. (Currently amended) The method of claim 1, further comprising providing a calibration 
table having first data and second data correlated with each other, the first data concerning 
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comprising positions of pixels of the picture taken by the camera and the second data concerning 
comprising correction values which correct lines of sight to correspond to directions and 
positions of rays of light incident on the pixels of the picture, wherein the lines of sight are 
defined based upon the directions and positions of the rays of light incident on the pixels of the 
picture corresponding to the projection pixels, obtained by looking up the second data with the 
first data in the calibration table. 

3. (Currently amended) An apparatus for compositing a computer-graphics image created 
by rendering a three-dimensional model and a picture taken by a camera, comprising: 

a calibration table storage unit for storing a calibration table having first data and second 
data correlated with each other, the first data concerning comprising positions of pixels of the 
picture taken by the camera and the second data concorning comprising directions and positions 
of rays of light incident on the pixels of the picture corresponding to optical properties of the 
camera ; 

a line-of-sight calculation unit for obtaining lines of sight extending from a viewpoint to 
the three-dimensional model, based upon the directions and positions of the rays of light incident 
on the pixels of the picture, obtained by looking up the second data with the first data in the 
calibration table, so that each of lines of sight passing through projection pixels on a plane of 
projection conforms with a ray of light incident on a pixel corresponding thereto of the picture 
taken by the camera; 

a two-dimensional image generation unit for generating a two-dimensional image on the 
plane of projection from the three-dimensional model by tracing the lines of sight so as to obtain 
attributes of portions of the three-dimensional model corresponding to the projection pixels on 
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the plane of projection; and 

a composite image generation unit for superposing the two-dimensional image on the 
picture, to generate a composite image. 

4. (Original) The apparatus of claim 3, wherein each piece of the second data of the calibration 
table includes a direction in which a ray of light strikes on a pixel of the picture and a 
displacement from a base point to the incident light. 

5. (Original) The apparatus of claim 3, wherein one piece of the second data of the calibration 
table includes coordinates of two points on the incident light. 

6. (Currently amended) A program embodied on a computer readable medium for 
compositing a computer-graphics image and a picture taken by a camera, the program causing a 
computer to perform the steps of: 

definin g, in accordance with conditions in which the picture is taken, a three-dimensional 
model, a viewpoint, and a plane of projection, in a space established on a compute r, the 
conditions comprising at least one of the tilt angle of the camera relative to a ground surface and 
the position of a light source relative to the camera ; 

defining lines of sight extending from the viewpoint to projection pixels on the plane of 
projection so that each of the lines of sight conforms with a ray of light incident on a pixel 
corresponding thereto of the picture taken by the camera; 

tracing the lines of sight extending from the viewpoint through the plane of projection 
and the three-dimensional model to obtain attributes of portions of the three-dimensional model 
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corresponding to the projection pixels, thereby forming a two-dimensional image of the three- 
dimensional model on the plane of projection; and 

superposing the two-dimensional image on the picture to generate a composite image. 

7. (Currently amended) A method for rendering a three-dimensional model created by 
computer graphics into a two-dimensional image to be superposed on a picture taken by a 
camera to form a composite image, the method comprising: 

defining a viewpoint, and a plane of projection, in a space established on a computer 
where the three-dimensional model is located in accordance with the conditions in which the 
picture is taken, the conditions comprising at least one of the tilt angle of the camera relative to a 
ground surface and the position of a light source relative to the camera ; 

defining lines of sight extending from the viewpoint to projection pixels on the plane of 
pro jection so that each of the lines of sight conforms with a ray of light incident on a pixel 
corresponding thereto of the picture taken by the camera; 

tracing the lines of sight extending from the viewpoint through the plane of projection 
and the three-dimensional model to obtain attributes of portions of the three-dimensional model 
corresponding to the projection pixels; and 

setting the obtained attributes of the portions of the three-dimensional model to the 
projection pixels corresponding thereto, to form a two-dimensional image of the three- 
dimensional model on the plane of projection. 

8. (Currently amended) The method of claim 7, further comprising providing a calibration 
table having first data and second data correlated with each other, the first data concerning 
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comprising positions of pixels of the picture taken by the camera and the second data concerning 
comprising correction values which correct lines of sight to correspond to directions and 
positions of rays of light incident on the pixels of the picture, wherein the lines of sight are 
defined based upon the directions and positions of the rays of light incident on the pixels of the 
picture corresponding to the projection pixels, obtained by looking up the second data with the 
first data in the calibration table. 

9. (Currently amended) An apparatus for rendering a three-dimensional model created by 
computer graphics into a two-dimensional image to be superposed on a picture taken by a 
camera to form a composite image, the apparatus comprising: 

a calibration table storage unit for storing a calibration table having first data and second 
data correlated with each other, the first data concerning comprising positions of pixels of the 
picture taken by the camera and the second data concerning comprising directions and positions 
of rays of light incident on the pixels of the picture corresponding to optical properties of the 
camera ; 

a line-of-sight calculation unit for obtaining lines of sight extending from a viewpoint to 
the three-dimensional model, based upon the directions and positions of the rays of light incident 
on the pixels of the picture, obtained by looking up the second data with the first data in the 
calibration table, so that each of lines of sight passing through projection pixels on a plane of 
projection conforms with a ray of light incident on a pixel corresponding thereto of the picture 
taken by the camera; and 

a two-dimensional image generation unit for generating the two-dimensional image on 
the plane of projection from the three-dimensional model by tracing the lines of sight so as to 
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obtain attributes of portions of the three-dimensional model corresponding to the projection 
pixels on the plane of projection. 



10. (Currently amended) A program embodied on a computer readable medium for 
rendering a three-dimensional model created by computer graphics into a two-dimensional image 
to be superposed on a picture taken by a camera to form a composite image, the program causing 
a computer to perform the steps of: 

defining a viewpoint, and a plane of projection, in a space established on a computer 
where the three-dimensional model is located in accordance with the conditions in which the 
picture is taken, the conditions comprising at least one of the tilt angle of the camera relative to a 
ground surface and the position of a light source relative to the camera ; 

defining lines of sight extending from the viewpoint to projection pixels on the plane of 
pro jection so that each of the lines of sight conforms with a ray of light incident on a pixel 
corresponding thereto of the picture taken by the camera; 

tracing the lines of sight extending from the viewpoint through the plane of projection 
and the three-dimensional model to obtain attributes of portions of the three-dimensional model 
corresponding to the projection pixels; and 

setting the obtained attributes of the portions of the three-dimensional model to the 
projection pixels corresponding thereto, to form a two-dimensional image of the three- 
dimensional model on the plane of projection. 

1 1 . (Currently amended) The program of claim 6, further comprising a calibration table 
having first data and second data correlated with each other, the first data concerning comprising 
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positions of pixels of the picture taken by the camera and the second data concerning comprising 
correction values which correct lines of sight to correspond to directions and positions of rays of 
light incident on the pixels of the picture, wherein the lines of sight are defined based upon the 
directions and positions of the rays of light incident on the pixels of the picture corresponding to 
the projection pixels, obtained by looking up the second data with the first data in the calibration 
table. 

12. (Currently amended) The program of claim 10, further comprising a calibration table 
having first data and second data correlated with each other, the first data concerning comprising 
positions of pixels of the picture taken by the camera and the second data concerning comprising 
correction values which correct lines of sight to correspond to directions and positions of rays of 
light incident on the pixels of the picture, wherein the lines of sight are defined based upon the 
directions and positions of the rays of light incident on the pixels of the picture corresponding to 
the projection pixels, obtained by looking up the second data with the first data in the calibration 
table. 

13. (new). The method for compositing a computer-graphics image and a picture taken by a 
camera according to claim 1, further comprising the method step of defining each line of sight 
extending from the view point to the projection pixels using 

a displacement vector comprising a 3-D vector representing displacement from the 
viewpoint to a displaced viewpoint, 

a direction vector comprising a 3-D vector representing direction from the displaced 
viewpoint toward the projection pixel, 
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wherein the displaced viewpoint is obtained by shifting a starting position of a 
corresponding line of sight from the viewpoint of the corresponding line of sight by a 
displacement amount corresponding to the displacement vector, and 

wherein the line of sight for a given projection pixel is determined using the viewpoint, 
the displacement vector, and the direction vector. 

14. (new). The program embodied on a computer readable medium for compositing a 
computer-graphics image and a picture taken by a camera according to claim 6, further 
comprising the method step of defining each line of sight extending from the view point to the 
projection pixels using 

a displacement vector comprising a 3-D vector representing displacement from the 
viewpoint to a displaced viewpoint, 

a direction vector comprising a 3-D vector representing direction from the displaced 
viewpoint toward the projection pixel, 

wherein the displaced viewpoint is obtained by shifting a starting position of a 
corresponding line of sight from the viewpoint of the corresponding line of sight by a 
displacement amount corresponding to the displacement vector, and 

wherein the line of sight to a projection pixel is determined using the viewpoint, the 
displacement vector, and the direction vector. 

15 (New). The apparatus for compositing a computer-graphics image created by rendering a 
three-dimensional model and a picture taken by a camera according to claim 3, wherein the 
second data comprises 
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a displacement vector representing the displacement of a displacement viewpoint relative 
to the viewpoint, and 

a direction vector representing a direction of the line of sight from the displacement 
viewpoint to the projection pixel. 
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